A CONCENTRATION INEQUALITY AND A LOCAL LAW FOR THE 
SUM OF TWO RANDOM MATRICES 



VLADISLAV KARGIN 



Abstract 



Let Hn = An + UnBnU n where An and Bn are two N-by-N 
Hermitian matrices and Un is a Haar-distributed random unitary 
matrix, and let fijj N , ^a n , ^B N be empirical measures of eigen- 
values of matrices Hn, An, and Bn, respectively. Then, it is 
known (see [16 ]) that for large N, the measure fijj N is close to the 
free convolution of measures ^a n and \i b n , where the free convo- 
lution is a non-linear operation on probability measures. The large 
deviations of the cumulative distribution function of fijj N from its 
expectation have been studied by Chatterjee in [8]. In this paper 
we improve Chatterjee's concentration inequality and show that it 
holds with the rate which is quadratic in N. 
In addition, we prove a local law for eigenvalues of Hn n , by 
showing that the normalized number of eigenvalues in an inter- 
val approaches the density of the free convolution of \ia and \i% 
provided that the interval has width (log N) 1 . 

1. Introduction 

If A and B are two Hermitian matrices with a known spectrum, it is a classical 
problem to determine all possibilities for the spectrum of A + B. The problem goes 
back at least to H. Weyl (EH). Later, Horn (| 13J) suggested a list of inequalities 
which must be satisfied by eigenvalues of A + B, and recently, Knutson and Tao 
( ifTSIl ) using earlier ideas by Klyachko, proved that this list is complete. 

For large matrices, it is natural to consider the probabilistic analogue of this 
problem, when matrices A and B are "in general position". Namely, let Hn = 
An + UnBnU n , where An and Bn are two fixed iV-by-iV Hermitian matrices, 
and Un is a random unitary matrix with the Haar distribution on the unitary group 
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U (N) . Then, the eigenvalues of Hjy are random and we are interested in their 
joint distribution. 

Let > . . . > \ ff denote eigenvalues of An, and define the spectral mea- 
sure of Am as ha n ■= N^ 1 J2k=i ^\i A ~) ■ Define /j,b n and [ih n similarly, and note 
that fiH N is random even if fiA N and jit b n are non-random. What can be said about 
relationship of fj, Aff , /i Bn , and fi Hir l 

An especially interesting case occurs when N is large. This case was investi- 
gated by Voiculescu ( Il20l0 and Speicher (UH) who found that as N grows hh n 
approaches ha n ffl ^B N , where EE denotes free convolution, a non-linear opera- 
tion on probability measures introduced by Voiculescu in his studies of operator 
algebras. Their proofs are based on calculating traces of large powers of matrices 
and use ingenious combinatorics. Later, Pastur and Vasilchuk ( ifToTl ) applied the 
method of Stieltjes transforms to this problem and extended the results of Speicher 
and Voiculescu to measures with unbounded support. 

It appears natural to ask the question about deviations of (ijj N from ha n SfiB N - 

In order to illuminate the issues that arise, suppose first that we place N points 
independently on a fixed interval [a, b] , each according to a measure v. Let the 
number of points in a sub-interval / be denoted ATj. Then, Mi is a sum of inde- 
pendent Bernoulli variables and satisfies the familiar central limit law and large 
deviation estimates. In particular, 

Pr {|^T" E (w\) \ >6 }~ C1 exp [ ~ C2d2N] (1) 

for large N. 

A remarkable fact is that for random points corresponding to eigenvalues of 
classical random matrix ensembles, the asymptotic is different and given by the 
formula 

Pr { W[F\ ~ E (fpt) > 4 ~ Cl exp [ -C2/ {6) n2 } • (2) 

Intuitively, there is a repulsion force between eigenvalues which makes large devi- 
ations of Mi much more unlikely for large N. 

For classical ensembles this fact was rigorously shown in a more general form in 
HI . Later, this result was extended to matrices of the form A^ + sX]^, where A^ 
is an Hermitian N-by-N matrix and X is an Hermitian Gaussian N-by-N matrix; 
see for an explanation Sections 4.3 and 4.4 in ifTl . 

The fluctuations of eigenvalues of matrices Hn = An + UnBnU n were con- 
sidered by Chatterjee in [8]. By an ingenious application of the Stein method he 
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Pr {\F Hn (x) - ET Hn (x)| > 5} < 2 exp 



proved that for every ieK, 

" -d> J!L' 

logiV 

where Ph n (x) := -/V _1 A/(_ 0O!a ;] denotes the cumulative distribution function for 
eigenvalues of Hn, symbol E denotes the expectation with respect to the Haar 
measure, and c is a numeric constant. Note that the rate in this estimate is sublinear 
in N, hence the estimate is weaker than ©. In fact, it is even weaker than the 
estimate in £T|) because of the logarithmic factor (log N) , and therefore it does 
not contain any evidence of the repulsion between eigenvalues. 

The first main result of this paper is an improvement of this estimate and is as 
follows. 

Assumption Al. The measure ^la n ffl^ is absolutely continuous everywhere 
on R, and its density is bounded by a constant T/v- 

Theorem 1. Suppose that Assumption Al holds. Let Ph n andP^,N be cumulative 
distribution functions for the eigenvalues ofH^ = An+UnBnU^ and for fx a N tB 
fJ-B N > respectively. Then, for all N > exp ^(ci/<5) 4 ^ , 

P {sup \F Hn (x) - J" ffl ,iV (x)\ >s\< exp [-c 2 8 2 N 2 (log A^] , (3) 

where c%, c 2 are positive and depend only on := max{||^47v|| , ||-Sjv||}> Tn< 
ande G (0,2]. 

Up to a logarithmic factor, the rate in this inequality is proportional to N 2 , 
which is consistent with the possibility that the eigenvalues of matrix iJjv = An + 
UnB-nUn repulse each other. 

With respect to Assumption Al, it is pertinent to note that if ha n {{x}) < 1/2 
and fiB N ({x}) < 1/2 for every i6l (i.e., if the multiplicity of every eigenvalue 
of A jv and B>n is less than N/2), then (j,a n EH ^b n has no atoms (see Theorem 7.4 
in (H). Moreover, since p,A N and ^lb n are atomic, the results of [3] imply that the 
density of ha n EB fJ,B N is analytic (i.e., in C°° class) everywhere on R where it is 
positive. In particular, Assumption Al holds. 

If Assumption Al is relaxed, then it is still possible to prove a result similar to 
the result in TheoremQ] Namely, if [im,N is absolutely-continuous at the endpoints 
of interval I, then it is possible to show that for all sufficiently large iV 

N\I 

Indeed, the only place where Assumption Al is used is when the distance between 
Ph n and Pm,N is estimated in terms of the distance between muiz) and m^^(z) 



P 



>s\< exp [-c 2 5 2 N 2 {logNf 



(4) 
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and this is done by using Bai's theorem. In order to prove (@]), the original proof 
should be modified by using techniques from the proof of Corollary 4.2 in ifTOll 
instead of Bai's theorem. In this paper, however, we choose to concentrate on the 
proof of inequality (O. 

In addition, if Assumption Al fails and x is an atom of /j,a n EB/iB^ then by Thm 
7.4 in |5] there exist xa and xb such that xa + xb = x, and 

l*A N ({xa}) + Vb n ({xb}) - 1 = HA N ffl HB N ({a?}) • 

These xa and xb are eigenvalues of An and UnBnU n with multiplicities {ia n ({xa] 
and fiB N ({xb}) N, respectively. Hence, by counting dimensions and using the 
fact that eigenspaces of An and UnBnU n are in general position, we conclude 
that with probability 1, xa + xb is an eigenvalue of Hjy with multiplicity 

(flA N ({x A }) + HB N ({x B }) ~ 1) N. 
Hence, if x is an atom of fj,A N EE [Ib n » then we have the exact equality 

These considerations suggest that perhaps Assumption Al can be eliminated or 
weakened as a condition of Theorem [TJ 

Our main tools in the proof of Theorem Q] are the Stieltjes transform method and 
standard concentration inequalities applied to functions on the unitary group. 

In the first step, we establish the N 2 rate for large deviations of the Stieltjes 
transform of fj,jj N , which we denote mjj N (z) ■ This follows from results in HI and 
the fact that the Stieltjes transform of hjj n is Lipschitz as a function of Un and its 
Lipschitz constant can be explicitly estimated. 

It is not possible to prove a concentration inequality for Fh n (x) by a similar 
method because for some x this function is not Lipschitz in Un. An alternative 
is to use an inequality by Bai (Theorem 1231 in this paper), which gives a bound 
on sup^, \Fh n (x) — E-Fffjy (x) \ in terms of sup^, \m,H N (z) — "RmH N (z) \ , where 
z = x + irj. However, the second term in this inequality depends on smoothness of 
"&Fh n (x), which is difficult to establish. 

Instead, we show that sup x \EmH N (z) — mm, at (z)\ is small for rj := Imz > 
c/^logN. (Here mm,N (z) denote the Stieltjes transform of ^a n ^^b n -) This es- 
timate allows us to use Bai's inequality and estimate sup x \Fh n (x) — ^Fm,N ( x )\ 
in terms of the sum of sup^, \rriH N (z) — ^mH N (z) \ andsup x \ErriH N (z) — rns,N (z 
which are both small. The benefit of this change is that smoothness of !Fm,N (x) is 
easier to establish than the smoothness of W^Fh n (x) . In our case it is guaranteed 
by Assumption Al. 



A CONCENTRATION INEQUALITY AND A LOCAL LAW FOR THE SUM OF TWO RANDOM MATRICES 

For large Imz, the difference \Eitih n { z ) ~ m fB,N( z )\ can be estimated by apply- 
ing Newton's iteration method (as perfected by Kantorovich in [14J) to the Pastur- 
Vasilchuk system for ~Kmjj N {z). Namely, we use mffl^(z) as the starting point for 
this method and show that for sufficiently large N the difference of the solution of 
the system, Em% (z) , and the starting point is less than any fixed S > 0. 

This method fails for small Iraz. We use a modification of Hadamard's three 
circle theorem (H21) in order to estimate the difference \EmH N (z) — mm, at (z)\ 
in the region close to the real axis. 

Theorem [TJimphes the following local law result. Let N v (E) denote the number 
of eigenvalues of Hn in an interval of width 2rj centered at E, and let qb,n (E) 
denote the density of p,A N EB Hb n at E. 

Theorem 2. Suppose that rj = r/ (JV) and 1 / \/Iog N <C rj -C 1. Let assumption 
Al hold with Tjy = T. Assume also that max {||^4jy|| , ||Sjv||} < K for all N. 
Then, for all sufficiently large N, 

where c > depends only on K and T. 

(Here the notation (N) < g(N) means that limjv->oc g (N) /f(N) = +oo.) 

The plan of the rest of the paper is as follows. We start in Section [2] by estab- 
lishing our notation. Section [3]provides a large deviation estimate for the Stieltjes 
transform of nn N and a related function. In Section 01 we use this estimate to 
bound error terms in the Pastur-Vasilchuk system, which we re-derive for reader's 
convenience. Section [5] is devoted to estimating \EmH N (z) — (z)\ in the 

region where Imz > r/o, and Section [6] is concerned with estimating it in the re- 
gion Imz » 1/yTog N. Section Incompletes the proof of our two main theorems. 
Several concluding remarks are made in Section [8] 



2. Definitions and Notations 

We define Hjy = An + UnB^U^. The spectral measure of Hn is p,jj N := 
N^ 1 EfcLi d,(H) , where a[ are eigenvalues of H, counted with multiplicity. 
Its cumulative distribution function is denoted J~h n ( x ) := ^H N {{— oo,x]) . The 
number of eigenvalues of Hn in interval / is denoted A/j := NfjLjj N (I) , and 
N n (E) := N(E-ri,E+rj\ denotes the number of eigenvalues in the interval of width 
2r] centered at E. 



6 



VLADISLAV KARGIN 



The resolvent of Hn is defined as Gh (z) := (iTjv — z)~ l . Similarly, Ga (z) := 
(An — z)" 1 and Gb (z) := (Bn — . (For brevity, we will omit the subscript 
N in the notation for resolvents and Stieltjes transforms.) 

The Stieltjes transform of Hn is defined as 

Vh n (dX) 



m H (z) :=N- 1 TrG H (z)= [ 

JR 



X-z 1 

where Tr denotes the usual matrix trace. The Stieltjes transforms of An and Bn 
are defined similarly, e.g., tua (z) = N~ lr TrGA (z) . More generally, if \i is a 
probability measure, then its Stieltjes transform is defined as 

f fj,(dX) 

(z) ~ 



X-z 

In addition, we define the following quantities: 



and. 



f B (z) := N- lr Tr (u N B N U N —^ ) 

V n N -zJ 

f A (z) := N- lr Tr(A N —}—) 
V H N - zj 



Next, we define the free convolution. Consider the following system: 

m(z) = m A (z- S B (z)) , (5) 
m(z) = m B (z-S A (z)), 

Z H 7-r = Sa (z) + S B (z) , 

m(z) 

where m (z), Sa (z) , Sb (z) are unknown functions. 

Proposition 3. There exists a unique triple of analytic functions m(z) , Sa (z) , Sb (z) 
that are defined in C + = {z : Imz > 0} , satisfy system (0, and have the following 
asymptotics as z — )• oo: 

m{z) = -z- 1 + 0(z~ 2 ), (6) 

S a ,b(z) = 0(1). 

Moreover, the function m (z) maps C + to C + and the functions Sa,b ( z ) map C + 
to CT = {z : Jmz < 0} . 

Prop. [3] implies that the first function in this triple, ma,N(z), is the Stieltjes 
transform of a probability measure. This measure is called the free convolution of 
measures [aa n and \i b n and denoted ha n ffl ^b n ■ (F° r shortness, we will some- 
times write this measure as p,m,N-) The two other functions in this triple, Sa (z) 
and Sb (z) , are called subordination functions. 
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Proof of Prop. S The uniqueness of the solution of system ((51) was proved in 
Prop. 3.3 in ([16]). However, it appears that their proof does not show that the 
solution exists everywhere in the upper half-plane. We prove the existence and 
uniqueness differently, by establishing a one-to-one correspondence between solu- 
tions of (UJ and certain objects in free probability theory. After this correspondence 
is established, the existence, uniqueness and claimed properties of the solution fol- 
low from the corresponding properties of the free probability objects. 

Recall that in the traditional definition of free convolution (see |fl9l ), one defines 
the /^-transform of measure [ia by the formula Ra (t) = m A ^ (— t) — 1/t, where 
m A ^ is the functional inverse of tua, chosen in such a fashion that Ra (t) is 
analytic at t = 0. The function Rb (t) is defined similarly. Then, one proves 
that R = Ra + Rb is the i?-transform of a probability measure, and one calls 
this measure the free convolution of \ia and \xb- In fact, this definition of free 
convolution is equivalent to the definition we have given above. 

Indeed, let mi^ be the Stieltjes transform of ha n ffl/is^ as it is usually defined, 
that is, let it equal the functional inverse of R + 1/t multiplied by —1. By definition 
of Ra, the first equation of (0) can be written equivalently as 

S B (z) = z-\ 3—— - R A (-mm jv (z)) , 

which we can use as a definition of Sb (z) . This definition holds only for suffi- 
ciently large z. However, by the results of Biane ([6]), Sb (z) can be analytically 
continued to the whole of C + . If we write the second equation in a similar form, 
add them together, and use the equality R = Ra + Rb, then we get: 

2 

Sa (z) + Sb {z) = 2z-\ —-R(-m^N{z)) 

m s ,N {z) 

1 



which is the third equation of system (f5J. By analytic continuation it holds every- 
where in C + . This shows that if {z) , Sa (z) , and Sb (z) are defined using 
the traditional definition of free convolution, then they satisfy system ©. In partic- 
ular this shows the existence of the solution of © as a triple of analytic functions 
defined everywhere in C + . 

Conversely, if ma,N {z) , Sa (z) , and Sb (z) satisfy ((5J with asymptotic condi- 
tions ©, then in a neighborhood of infinity we can write 

Ra (-ma,N (z)) = (ma,N (z)) + l/mm,N (z) 

= z-S B (z) + l/m BtN (z), 
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where the first line is the definition of Ra and the second uses the first equation of 
(121). If we write a similar expression for R B (— m-B.Ar (z)) , add them together, and 
use the third equation of Q, then we find that 



This shows that ma,N ( z ) satisfies the same functional equation as the Stieltjes 
transform of the free convolution measure defined in the traditional fashion. Since 
their power expansions at infinity are the same, these functions coincide. In partic- 
ular, this shows that the solution of Q is unique as a triple of analytic functions in 
C + that satisfy asymptotic conditions ©. 

Finally, the claimed properties of m^jv {%) and Sa,b i z ) follow from the prop- 
erties of the Stieltjes transform of a probability measure and of the subordination 
functions. The latter were established by Biane in (0). □ 

We denote the cumulative distribution function of [ia n EE [i Bn as Ts,N and its 
density (when it exists) as qs,n- 

The integration over U using the Haar measure will be denoted as E. (This 
operation is often denoted as (•) in the literature.) Correspondingly, P (u>) denotes 
the Haar measure of event to. 

We will usually write z = E + irj, where E and r] denote the real and imaginary 
parts of z. We will also use the following notation: 



3. Concentration for the Stieltjes transform and associated 



The main result of this section is the following large deviation estimates for 

m H (z) and f B (z) . 

Proposition 4. Let z = E + ir) where rj > 0. Then, for a numeric c > and every 



R{-m m ^ N (z)) 



z + l/mm,N{z)- 



'»7o,c — 



{z £ C : Imz > rjo, Imz > cRez} . 



FUNCTIONS 



5 > 



P{\m H {z) - Em H (z)\ > 5} < exp 




and 



P{\f B (z)-Ef B (z)\>5}<ex V 



cb 2 rf 



B 



jN 2 / f 1 + p|) • W 



Proof: The first claim of this proposition follows directly from Corollary 4.4.30 
in HI. The second claim can be obtained by a modification of the proof of this 
Corollary. For the convenience of the reader we give a short proof of both claims. 
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Both claims are consequences of the Gromov-Milman results about the concen- 
tration of Lipschitz functions on Riemannian manifolds ( ifTTTO . In a small neighbor- 
hood of identity matrix, all unitary matrices can be written as U = e lX , where X 
is Hermitian. We identify the space of Hermitian matrices X with TU, the tangent 
space to U (N) at point U. By left translations this identification can be extended 
to the tangent space at any point of U (N) . Define an inner product norm in TU 

( 2\ 1/2 

by the formula ||X|| 2 = [z2ij l-^ijl ) • This gives us a Riemannian metric ds 
on U (N) . The Riemannian metric on SU(N) can be defined by restriction. 

The (real or complex-valued) function / (x) on a metric space M is called Lips- 
chitz with constant L if for every two points x, y £ M, it is true that \f (x) — f (y)\ < 
Ld (x,y), where d(x,y) is the shortest distance between x and y. 

Proposition 5. Let g : (SU (N) , ||c/s|| 2 ) — > M be an L-Lipschitz function and let 
Eg = 0. Then 

( i) E exp (tg) < exp (ct 2 L 2 /N) for every t £ R and some numeric c > 0, and 

(ii) -P{|<?| > 5} < exp (— c\N5 2 /L 2 ) for every 5 > and some numeric c\ > 0. 

For the proof, see Theorems 3.8.3 and 3.9.2 in [7] and Theorem 4.4.27 in JT]. 

In order to apply this result, we need to estimate the Lipschitz constants for 
itih (z) and fs {z). If M is a Riemannian manifold and / is a differentiable func- 
tion on M, then it is Lipschitz with constant L provided that \dxf(x)\ < L for 
every x G M and every unit vector X £ TM X . Here dx denotes the derivative in 
the direction of vector X. We will apply this general observation to the manifold 



We differentiate itih (z, X) with respect to X (and evaluate it at X = 0) by using 
the chain rule. 



SU{N). 

Let B denote UBU*, B (X) 



e ix Be -ix and let 



m H (z,X) = {A + B{X)-z) 



-l 



\d x m H (z,X)\ 



E 



duiH (z) 



dxB xy (X) 
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where we used the facts that dmn/d (^B xy ^j = —N 1 (G 2 ) yx and that dxB (X)\ x=0 



IB 



These facts can be easily checked by a calculation. For the first one, see 



Lemma [9] below. 



If || X || 2 = 1, then it follows that 



\d x m(z,X)\ < - 
1 



< 



< 



'N 
2\\B 



G , B 



G 2 ,B 



Nrf 



Together with Proposition [5] this implies the first claim of the lemma. 

For the second claim, let f B (z, X) = B (X) (A + B (X) - z)' 1 . Note that 

B [ A + B - z ) = I — (A — z) (a + B — z) . This allows us to calculate: 



dB 



(> (f B ( z ,X)) = ±-(G(A-z)G) 



j-y 



N 



Hence, 



\dxf(z,X)\ 



J2 d -^d x B xy (X) 



x,y dB *y 



< 



< 



1 -\\[G(A-z)G,B 



X X i 



<)■>; 



G(A-z)G,B 



Since (A — z) G = I— BG, we can continue this as 



\d x f(z,X)\ < 



N V V 



\B\\ \\B\ 



and the rest follows from Proposition |5] □ 

Later, we will need the following consequence of Proposition @] 

Corollary 6. Let 1^ = [-2K + irj, 2K + irj\. Then for some positive c and c\ 
which may depend on K and for all 5 > 0, 



P < sup \rriH (z) — ^rriH (z)\ > 5 > < exp 
zei„ 



\B\ 



A CONCENTRATION INEQUALITY AND A LOCAL LAW FOR THE SUM OF TWO RANDOM MATRICES 



provided that N > c\ \ \J — log (r] 2 5)J / (r) 2 6) . 

Proof of Corollary: Note that \m' H (z)\ < r/~ 2 and \Em' H (z)\ < r/~ 2 and 
that it is enough to place O (K/rfti) points on interval I v to create an e-net 
with e = tj 2 S/A. If \rriH (z) — Em// (z)| < 5/2 at every point of the net, then 
\rriH (z) — Em// (z)\ < 5 for all z 6 I v . Hence, by Theorem 01 



P < sup \m H (z) - Em// (z)\ > 5 > < ^^exp)-- — 



c'K ( cb 2 rf 
rj 2 S V \B 



! c6 2 V \ t2 , fc'K 



if N > c\ \ \J — log {t] 2 5)j I [rj 2 5) and c\ is sufficiently large. □ 
4. An estimate on error TERMS IN the Pastur-Vasilchuk SYSTEM 

For the convenience of the reader, we re-derive here the Pastur-Vasilchuk sys- 
tem. This is a system of equations for Em// (z), Ef A (z) , and EJb (z) . When N 
is large, this system is a perturbation of system ([5]), and the main purpose of this 
section is to estimate quantitatively the size of this perturbation. Later, we will 
show that system (0) is stable with respect to small perturbations, and therefore for 
large N the function Em// (z) is close to the Stieltjes transform of [i An EE fJ,B N - 

We use notations 

A A := {m H - Em//) G H - G A (f B - Ef B ) G H 

and 

R A := — !— ^Tr f ) V7^ EAa ) ' (9) 

Em// N V 1 + (E/ B /Em//) y 

with similar definitions for A# and Rb- 

Theorem 7 (Pastur-Vasilchuk). The functions Em// (z) , E/a (z) and Ef B (z) sat- 
isfy the following system of equations: 

Em// (z) = m A (z- ® fB ^\ ) + R A (z) , (10) 

V Em H {z)J 

Em// (z) = m B [z - + -Kb (2) , 

V Em// (z) y 

1 Ef A (z) + Ef B (z) 



Em// (z) Em// (z) 

where R A and Rb are defined as in ((9]). 
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The main technical tool in the proof of this theorem is the following formula due 
to Pastur and Vasilchuk. Recall that G B is the resolvent of = A^ + U nB^U^ 
where Un is the Haar distributed random unitary matrix. 

Proposition 8. E (itlhGh) = E {tuhGa - G A f B G B ) ■ 

This result immediately implies Theorem [7] Indeed, the identity in Proposition 
[8] can be written in the following equivalent form. 



(Em H )EG H = (Em H )G A -(Ef B )G A EG H 

+ E[(m H - Em H )G H ] - G A E[(f B - Ef B )G H ] 
= (Em H )G A - (Ef B )G A EG H + EA A . 

This expression can be further re- written (after we multiply itby An — z and re- 
arrange terms) as 

Em H (a n -(z- ^ EG H = Em H + (A N - z) EA A . 

Let z' := z — Ef B / Em. Then for almost all values of z, 

Em H EG H = G A (/) Em H + (A N - z) G A [z') EA A . 

Take the normalized trace and divide the resulting expression by Emu . Then, we 
obtain 

Em H (z) = m A (z') + =r^^Tr ( 1 EA A ) . 

K ' Em H N \1 + (E/s/Em) G A J 

= m A [z') + R A . 

The second equation of the system is obtained similarly and the third equation is 
an identity. 

Proof of Prop. M It is useful to use notation B = U N B N U* N and B (X) = 
e iX Be~ iX . Note that by using the resolvent identity G H {z)-G A (z) = -G A (z) BG H (z) 
we know that 



E(m H G H ) = E[m H G A -m H G A BG H 
= G A E ( m H - m H BG H ) . 



Hence, it is enough to show that E (^mHBGH^J = E (J b Gh) , 
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Lemma 9. Let A and B be two arbitrary matrices and G (z) = (A + B — 1 . 
Then, (dG/dB xy ) uv = —G ux G yv . In particular, 



(dG/dB xy ) M xy 



^ G ux M xy G yv . 



x,y 



Proof: This is an immediate consequence of the resolvent identity Gx+y (z) — 
G x (z) = -G x (z) YGx+y (z) applied to X = A + B and Y = tE x y, where 
E xy denote the matrix that have 1 in the intersection of row x and column y and 
zeroes elsewhere. □ 

Lemma 10. For every u, v, a, b, it is true that 



E 



BG H 



bv 



E {(G H B) (G H 



(A + B(X)-z 



,-i 



Proof: Note that d [E 

matrix X, because the distribution of B (X) = e 
distribution of B. We can compute 

8G H dB (X) 



jdt = for every Hermitian 
ltx Be ltx is the same as the 



d_ 

dt 



(A + B(X)-z 



,-i 



t=o 



xy 



x,y dB xy 

dGi 
dB 3 



dt 



t=o 



x,y a &xy s 

Let E ab denote an iV-by-iV matrix that has zeros everywhere except at the in- 
tersection of the a-th row and 6-th column, where it has entry 1. If we set X = 
E ab + E ba and use Lemma |9j then we obtain 

—~E[(GH)ua(BGH)bv + {GH)ub{BGH)av\ 

+K[(GHB) ua (G H )bv + {G H B) ub (G H )av] = 0. 

If we set X = i (E ab - E ba ) , then we obtain a similar expression and adding 
them together, we get: 



E 



( G H) ua [BG H ) i +[G H B) (G H ) bv 



bv 



0. 



□ 



If we take u = a in the statement of Lemmas [TOl then we get 



^ (G H ) aa BG H 



bv 



E((G H B) (G h ) 



By adding up these equalities over a and dividing by N, we obtain that E (^tihBGh^J 
E (/bGh) , and Proposition [8]is proved. □ 
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Now, we are going to estimate the error terms Ra and Rb- Let rjo > and 
K > 0. For our purposes it is sufficient to make the estimates in the region 



^r/ ,re '■= {z £ C : Imz > rjo, Imz > uRez} . 

Proposition 11. Assume that max{||^4|| , ||S||} < K and let k > 0. There exists 
an r/Q = cK such that for every z = E + ir/ E £lr] ,K, it is true that 

\Ra\< C 



Nrj 2 

where C > and depends only on K and k. 

In order to prove this result, we will proceed in two steps. First, we will estimate 
||EA^|| . Then we estimate the multipliers before EA^ in the definition of Ra- 

Proposition 12. Let z = E '+iry. Assume that rj > r]Q and that max {\\A\\ , \\B\\} < 
K. Then 

P{\\A A (z)\\ >e}< exp {-cs 2 rfN 2 } , 
and ||EA^4 (z) || < c/ (Nr] s ) where constants depend only on K and t]q. 

Proof of Proposition Il2t 

Lemma 13. Let z = E + irj, where rj > 0. Then for a numeric c > 0, 
a) 

P{\\(m H (z)-Em H (z))G H \\ > e} < exp 



F 2 6 

-c^N 2 



and b) 

P{\\G A (fB(z)-Ef B (z))G H \\ >e}<exp 



\B\ 



-C^trN 2 / ( 1 + 



51 



B\ 



Proof: Note that if X is a Hermitian matrix and r] > 0, then 
l/r/. By using this fact and Proposition 01 we get 

b 2 rf 



(X-ir,) 



-1 



< 



P{\\{m H {z)-Em H (z))G H \\>6/rj}<exp 



\B\ 



Claim (a) of the lemma follows if we set e = 5/rj. Claim (b) follows from Propo- 
sition @] in a similar fashion. □ 

The first claim of Proposition [T2l directly follows from Lemma [T3l 
For the second claim, note that ||EA^|| < E \\Aa\\ by the convexity of norm, 
and E ||A^|| can be estimated by using the first claim of Proposition [121 and the 
equality 

poo 

EX= / (1-T x (t))dt, 
Jo 
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valid for every positive random variable X and its cumulative distribution function 
Tx (t) • In our case, we obtain 



POO 

E \\A A \\ < / exp [-ct 2 rfN 2 ] dt 
Jo 



Nr] 3 



□ 



Proposition 14. Let z = E + irj where 77 > 0. Assume that {\\A\\ ,\\B\\} < K. 
Then, there exists such an t/q = cK with numeric c > 0, that for every rj > 770, 



(1 + (Ef B /Em H ) G A (z))- 1 



< 2. 



The proof uses the following result. 

Lemma 15. Assume that {\\A\\ , \\B\\} < K. Then, for some numeric c > 0, the 
functions Em (z) , E/b (z) , andEm (z) /E/g (z) can be represented by uniformly 
convergent series in z^ 1 in the area \z\> cK, 



Em (z) 

E/b (z) 

E/g (z) 
Em (z) 



a k m z 



00 
fe=l 

00 
k=0 



The proof of the first two equalities is by expansion of (A + B — z)~ and 
B (A + B — in convergent series of z' 1 and estimating the coefficients in 
these series. This establishes the uniform convergence in the area \z\ > cK and 
ensures that it is possible to take expectation and trace of the series in a term-by- 
term fashion. The third equality follows from the first two. □ 

Proof of Proposition [I4j By the previous lemma, Efs /Emu is analytic in 
z~ x and therefore bounded if \z\ > cK. Since \\Ga (z)\\ < I/77, we can choose 
770 = cK with sufficiently large c, so that 7/ > 770 ensures that 



E/b (2) 



Em# far' 



< 1/2, 



and 



□ 



1 + to TT Ga 

Em// (z) 



-1 



< 2. 
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Proof of Proposition Hit For every matrix X, it is true that \N x Tr (X)\ < 
\X\\. Hence, by using Propositions [T2l and fl4l 



1 



-EA A 



< 



1 



1 + (Ef B /Em H ) G A 



Nrj 3 ' 



1 + (E/ B /Em H ) G A 
provided that r\ > rjo = cK. 

By using the power expansion for m(z), we find m (z) 1 < 2|z| < 2r]y/l + k~ 2 
if \z\ > cK. It follows that for z G ^J7 , K) 

□ 



5. Stability of the Pastur-Vasilchuk system 

By results of [16], the solution of system ( fTOl ) exists and unique in the upper 
half-plane C + . We are going to show that the solutions of systems (fTOb and ([5]> are 
close to each other. 

Proposition 16. For all z G f2 c x,K> 

c ' 

max{|Emtf (z) - m m ,N (z)\} < — , 
where c and d depends on K and K only. 

The idea of proof is to use the solution of the system (f5]) as the starting point 
of the Newton-Kantorovich algorithm ( Ifl4l0 that computes the solution of system 

<E9. 

It is convenient to use a more uniform notation, so we write system (fTOb in a 
more compact form: 

— )-Ra = 0, (11) 
X -A-Rb = 0, 

Xx J 

ZXx - X2 - x 3 + 1 = 0, 

The starting point of the algorithm is x m = (m^jy, S'^ma j iv, Sgm^N) ; where 
"T-ffl,Af (-2) j <?A (^) , and Sb (z) are the solutions of ©.The variable z plays the role 
of a parameter. 

We assume that Ra and Rb are evaluated at the solution of (fTOb and fixed. 
Hence, in (|TTb . i?^ and Rb do not depend on x. The solution of (TTOb remains a 
solution of this simplified system. 



xi — rriA z 



xx — rriB z 
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In a shorter form, system (fTTT) can be written as 

P(x) = 0. (12) 

Now, let us explain the Newton-Kantorovich method. Let ([121 be a general non- 
linear functional equation where P is a non-linear operator that sends elements of 
a Banach space X to a Banach space Y. Let P be twice differentiable, and assume 
that the operator P' (x) has an inverse [P ! {x)]~ l G L(Y,X) where L(Y,X) 
denotes the space of bounded linear operators from Y to X. Then the Newton- 
Kantorovich method is given by the equation 

x n+ i = x n - [P' (x n )] ~ X P (x n ) . 

The Kantorovich theorem (i) gives the sufficient conditions for the convergence 
of this process, (ii) estimates the speed of convergence, and (iii) estimates the dis- 
tance of the solution x* from the initial point xq. We give the statement of the 
theorem omitting the claim about the speed of convergence, which is not important 
for us. 

Theorem 17 (Kantorovich). Suppose that the following conditions hold: 

(1) for an initial approximation xq, the operator P' (xq) possesses an inverse op- 
erator Tq = [P' (xo)]" 1 whose norm has the following estimate: \\Tq\\ < Co, 

(2) \\Y Q P{x Q )\\ <5 , 

(3) the second derivative P" (x) is bounded in the domain determined by inequal- 
ity (0 below; namely, \\P" (x)\\ < M, 

(4) the constants Co, 5q, M satisfy the relation ho = CqSqM < 1/2. 

Then equation rf72l) has a solution x* , which lies in a neighborhood of xq deter- 
mined by the inequality 



\\x - xo\\ < 7 o , (13) 

h 

and the successive approximations x n of the Newton method converge to x* . 

Proof of Proposition [I6t In order to apply the Newton-Kantorovich method, 
let us calculate the derivative P' (x) for our system: 

\ Z -1 -1 

Then, the determinant is 

/^a m't+rn'r, m' A m' n , . 
det (P') = ^ ^ + A s (-ZX! +x 2 + x 3 ) , 

x ' x\ xf 



XI I XI 
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where m' A and m' B are short notations for m' A 



^ ) and m'n 

xx I B 



£1 
xi 



re- 



spectively. 

The power expansions from Lemma[T5land the definitions of uia and mg imply 



that x\ 



X-2 



a z 1 , x 3 



(3 z 1 , m' A 



~ z 



~ 2 , and m\ 



B 



~ Z 



for 



oo. Hence 



det (P') =- + 0(1) 



in the area \z\ > cK, where the constant in O (1) depends only on K. 

(The proof that we gave for Lemma [T51 holds only for xi = mn N (z) , X2 = 
Ja n (z) , and X3 = fs N (Z). However, by using results from free probability, 
these power expansions can be established in the case when xx, X2 and X3 are 
defined as mm,Ni £>A m Ei,N and S , j B"im,Af, respectively.) 

Now, it is easy to calculate the inverse of the derivative and find that 

/ 



r =[p'(x H )]- 1 




+ 0(1) 



(14) 



Hence 



||r || = M + o(i) 
< 2 M> 

if z G QcK.k, and c is sufficiently large. 

By using formula ([141 . we calculate for z G £I c k,k- 

||r P(x ffl )|| < \z\(\r a \ + \r b \) + o(\r a \ + \Rb\) 

< C r,(\R A \ + \R B \)<^, 



< ^ \z\ 1 . (Later 



where c' depends only on K and k by Proposition [TTJ 

The next step is to estimate || P" (x) \\ . Assume that \\x — x 
we will show that for large N this disc contains the disc given by (TT31).) By direct 
computation of the second derivatives, it is easy to check that if c is sufficiently 
large and z G Q c k.k, all second derivatives of P (x) are bounded by a constant, 
which can depend on K only. Hence, \\P" (x)\\ < M, where M depends on K 
only. 

Now we can apply Theorem [P71 with Co = 2 \ z\ , 5q = c'/Ntj, M as in the 
previous paragraph, and ho = Cq5qM. For all sufficiently large N, ho < 1/2 and 
disc (fT"3l) is inside the disc ||x — x m \\ <^|zp 1 so that the estimate for the second 
derivative holds. 
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Hence by Theorem [T7J if z G Q c k,k, then the Newton algorithm which starts at 
x m will converge to a solution of P (x) = and this solution satisfies inequality 
\\x — x m \\ < 2<5o = c/ (-/Vr?) . This completes the proof of Proposition [161 □ 

6. Hadamard's three circle theorem 

So far, we established the behavior of the difference \EmH N (z) — mm,N (z)\ 
only for the points where Imz > 770 • Here we prove a result about its behavior for 
small \mz. 

Proposition 18. Let be a straight line segment between points —2K + ir/jv 
and 2K + ir]N, where 77 at > c\/\/log N, and c\ is a positive constant that can 
depend on K. Then, 



sup \KrriH (z) — ms,N (z)\ < exp ^— c^Jlog N 
where c depends only on K. 

Corollary 19. Let -q^ = c\ (log N)~ a , where < a < 1/2 and I m be a straight 
line segment between points —2K + ir]N and 2K + irj^. Then, 



P < sup \m H (z) - m B>N (z)\ > 5 > < exp ( -c 2 S Z N 2 (logiV)~ 

[z^VN J V 

Constants c\ and c 2 depend only on K. 

Proof of Corollary [19} This result follows from Corollary [6] and Proposition 
[T8l which estimate |m# — Em^| and |Eto# — mm,N\ , respectively, if we note 
that for sufficiently large N, |Era# (z) — ma,N ( z )\ < 5 for all z 6 I m . □ 

For the proof of Proposition \TE\ we use the three circle theorem by Hadamard 
(HEl or G3). 

Theorem 20 (Hadamard's three circle theorem). Suppose that f (z) is a function 
of a complex variable z, holomorphic for \z\ < 1, and let M (r) = sup e / (re* 9 ) 
forr < 1. Then M (r) possesses the following properties: 

(1) M (r) is an increasing function ofr; 

(2) log M (r) is a convex function of 'log r, so that 

log M(r) < i^\logM(r 2 ) + l og M(r x ) 

log(r 2 /ri) log(r 2 /ri) 

< ri < r < r 2 < 1. 



We will need the following consequence of this theorem. 
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Lemma 21. Suppose f (z) is holomorphic for \z\ < 1, and let M (r) be defined as 
in Theorem\20\ Suppose that M (r) < c/ (1 — r) for all r < 1 and that M (e _1 ) < 
5, where < 5 < 5q and Sq depends only on c. Let 



r(6) 
e(5) 



vxp [ -4Vc/ log (l/<5) j , 
exp (-y/ clog (1/5)) . 



Then 



M (r) < e (5) 

for all r < r (5). 

(Note that if 5 -)■ 0, then r (5) -)■ 1 and e (<5) -)■ 0.) 




" -(cLf 



log M(r) 

T \ 112 

2(cL) 



logr 



-L=log5 



Figure 1 . Illustration to the proof of Lemma I2T1 



Proof: Let Lg = log (1/5), r = exp I— y/c/Ls) , and so = logr 
■y/c/L$. By assumption, 
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for all sufficiently small 5. In the plane (log r, log M), the equation of the straight 
line that goes through points (— 1, — L$) and (logro, 2\/cLs) is given by 

2^T 8 + L & 



l(s) 



^8 



(s + l)-L s 
(' + !)- 



■y/c+ y/Lg 

By Hadamard's theorem, logM (e s ) < I (s) for all s € [—1, sq] . Let us set 
s = 4sq = —4y/c/Ls. Then, 

I (s) = -\fcL~8 



9 Cx /Ls 



if L$ > c. 
Hence, 



-\/c + \/Ls 



logM(e s ) < -\/^L 5 



< 



if s = log r <s = —Ay/c/Ls and <5 < So (c) . □ 

Since we are interested in functions on the upper half -plane rather than on the 
unit disc, we have to make a change of variables before we are able to apply 
Hadamard's theorem. Consider the following map: 

w — ia 



w + ia 

where a is a positive real number. This map sends the upper half-plane C + = 

{w : Imw > 0} bijectively to the unit disc D= {z : \z\ < 1} . In particular, it sends 

point ia to the center of the disc. The inverse transformation is 

. 1 + z 

w = ia . 

1 — z 

Let x£l and let £ = (x — ia)/ (x + ia) G 3D. Then 

1 1 



x — w 



2ai 



Let 



g{w) 



f 

j — i 



t-z 

dfj, (x) 
x — w 



where Imw > and fx is the difference of two probability measures. After the 
change of variable w = w (z) , this function becomes a function of variable z € D. 
We will denote it as / (z). Then, 

0(i-*) 



-di/(0, 



(15) 



where \z\ < 1 and v is the forward image of /j,, hence it is the difference of two 
probability measures on the unit circle 3D. 
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Evidently, / (z) is analytic for \z\ < 1. 

Lemma 22. Let f (z) be defined by formula rt/51 ) with v which is the difference of 
two probability measures on dD. Then, M(r) < 4a" 1 (1 - r) -1 . 

Proof: Clearly, |1 - £| < 2, |1 - z\ < 2, and |£ - z\ > 1 - \z\ . It remains to 
notice that the total variation of i/ is bounded by 2, since it is a difference of two 
probability measures. These facts imply that \ f {z)\ < 4a" 1 (1 - (z))" 1 . □ 

Proof of [18J The map w 
has the diameter 



la 



l+z 

1-z 



sends disc B (0, e x ) to a disc Z?i G C + that 



ta- 



1 e + 1 



e+1 e-1 

By an appropriate choice of a, disc D\ can be placed arbitrarily far from the real 
axis, hence we can apply Proposition [TBI and write 

c' 

sup \Em H (w) - m B)N (w)\ < —, (16) 

where d depends on K. 

Next, define 5 = d j (aN) and let r (5) 



as m 



exp ^-8a-V^log(l/o)^ 
Lemma [2T1 with parameter c = 4a _1 . The map w = ioj^f sends disc B (0, r (<5)) 
to disc L>2 G C + with the diameter 

. ~l-r(8) l + r(S)~ 

1 CI 

[l + r(6Y l-r(S)_ 
Note that the radius of D2 approaches infinity as 5 ], 0, and that 

l-r(o) 



in 



1 + r (5) 



4i 



log (1/5) 



Ai 



log (aiV/c') ' 



It follows that there exists a c\ > such that for rjjy = c\/^f\ogN all the points 
of the segment J w are located inside the disc . 
Hence, Lemma[2T]and estimate ( fT6l ) imply that 



sup |Em# (to) — ma jv ( w )\ < exp ( — 2\/ a 1 log (aiV/ 



w€l, 



'IN 



< exp ^-c 2 v / logiV 



(17) 



(18) 



□ 



7. Proof of Theorems Q] and [2] 

We use the following result due to Bai (see Theorems 2.1, 2.2, and Corollary 2.3 
in Q). We formulate it in the form suitable for our application 
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Theorem 23 (Bai). Let K = max{\\A N .B N ||} . Then, 

/C2K 
\m H (E + irf) - m fflj jv (E + irj) \ dE 
-c 2 K 

+- sup / I J" ffliJV (E + x)- F BtN (E)\ Qfy 

V E 7|:r|<4T7 

where c\ and C2 are numeric. 

Proof of Theorem [TJ By using Assumption A\, we can estimate 

\Tm,N (E + x) - Fm,N (E)\ < T N \x\ , 



and therefore the second term on the right-hand side of ( 1191 ) is bounded by WTj^-q. 

Let us set t}n = c\ (log A) _£//4 , where < e < 2. By Proposition 1X81 we can 
make 

sup \Em H (z) - m ffliA r (z)\ < 5/3, 

provided that N > (3/5) clog(3/<5) . We can also make 16T N r) N < 5/3 by choosing 
N > exp ((c/<5) 4/e ) . 

Then, we can use Bai's theorem and Corollary \\9\ and find that for all suffi- 



ciently large N 

P < sup \Fh n ~ Fm,N\ > $ } < P{ sup \m H (z) - m StN (z)\ > c5 



< P < sup \ttih (z) —KrriH (z)\ > ci5 

< exp (-c 2 5 2 N 2 (log N)- £ ) , 



where to make sure that the last inequality holds, it is enough to take 



N > Cl (Vloga/^))) / (r?6) . 
For small 5, the most binding inequality on N is N > exp ( (c/<5) 4 ^ £ ) . □ 



By using Theorem [TJ we can derive the following corollary and prove Theorem 
[2] Recall that Mi denotes the number of eigenvalues of H in the interval /. 

Corollary 24. Suppose the assumptions ofTheorem\J\hold, and assume in addition 
that r/ > c/ (e^/log N). Then the following inequality holds: 

p f ,M 1. ( 2 (riN) 2 

P < sup — — — > e > < exp — ce —77 

l N\I\ \I\ 1 " J " y V (log A) 2 

where c > depends only on K and T. 
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Proof: Let I = (a, b] . Then Mi/N = T Hn (b) - T Hn (a) and ^ N (I) 
Fm,N {b) — Jh,N ( a ) > an d therefore 

A// Hm,N(I) 



P 



sup 

I,\I\=V 



N\I\ 



> e 



P \ sup \F Hn (b) 

I a,b:b—a=r) 



Fm,N (b) - {Fh n (a) ~ Fa,N (a))\ > £V 



and the corollary is the direct consequence of Theorem Q] The assumption about 
77 is needed to ensure that N in Theorem Q] is sufficiently large and is forced by 
assumptions of Proposition [TU □ 

Proof of Theorem|2} Assumption Al with uniform T ensures that fia,N {I) I \I\ 
approaches qb,n (E) when / = (E — -q, E + rj\ and r\ — > 0. Moreover, the conver- 
gence is uniform in E. Hence the conclusion of the theorem is implied by Corollary 
□ 



8. Concluding remarks 

We have shown that the probability of a large deviation of the empirical c.d.f. 
of eigenvalues of + UnB^U^ from the c.d.f. of [ia n EB Hb n is bounded 
by exp (—cS 2 N 2 / log e N) . The same results holds for the ensemble in which Un 
denotes a Haar-distributed real orthogonal matrix. In this case Lemma [10] does 
not hold as stated and should be corrected. After this correction the identity in 
Proposition [8] becomes : 



GaIbGh) - —Ga^ 



E (m H G H ) = E (m H G A 
Hence, we need to re-define by adding an additional term 



(G H f,B 



G H 



(G H f,B 



Gh- 



The norm of this term is bounded by c/(Nrj 3 ), therefore the estimate ||.EAa|| < 
c/ (N-q 3 ) from Proposition [T2l remains valid and further analysis can be carried 
through without changes. 

It would be interesting to investigate whether the empirical measure of eigenval- 
ues satisfies the large deviation principle. At the very least, it should be expected 
that the limit 



N^-oo iv 



X 



>5} 



exists and is positive. It is also likely that the large deviation principle holds at 
the level of measures. For classical Gaussian ensembles the large deviation rate is 
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closely related to the free entropy of a probability measure: 



For more general large matrices with Gaussian entries, the large deviation rates 
were obtained in the work of Guionnet. It is not clear if there are similar formulas 
for the large deviation rate in the case of sums of random matrices. 

The second contribution of this paper is a local law for eigenvalues. It was 



to extend this law to smaller scales. In the case when the eigenvalue distributions 
of matrices An and Bn converge to limiting distributions \ia and /j,b with the 
free convolution \ia EB Hb, the author expects that the local law holds on the scale 
jy-i+e at a ii p 0m t s where the density of the free convolution exists. (A trivial 
cases when [ia or /jlb are concentrated on a single point should of course be ruled 
out.) 

Currently, the limit laws on this scale are known for the Gaussian symmetric and 
sample covariance matrices, where they are implied by the explicit description of 
the limiting eigenvalue process on the scale N . They have also been established 
in (3 for the Wigner and sample covariance random matrices. In this case, the local 
laws have been used as the first step in the proof of the universality conjecture for 
this class of random matrices. 

Another area of possible further research is to understand better the local struc- 
ture of the eigenvalues, in particular, the point process of eigenvalues and compare 
it to the structure of eigenvalues in classical ensembles of random matrices. One 
would expect that the point process of eigenvalues converges to a universal limit. 
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